Influence of gestural salience on the interpretation of spoken requests
نویسندگان
چکیده
We present a probabilistic, salience-based mechanism for the interpretation of pointing gestures together with spoken utterances. Our formulation models dependencies between spatial and temporal aspects of gestures and features of objects. The results from our corpus-based evaluation show that the incorporation of pointing information improves interpretation accuracy.
منابع مشابه
Interpreting Pointing Gestures and Spoken Requests - A Probabilistic, Salience-based Approach
We present a probabilistic, salience-based approach to the interpretation of pointing gestures together with spoken utterances. Our mechanism models dependencies between spatial and temporal aspects of gestures and features of utterances. For our evaluation, we collected a corpus of requests which optionally included pointing. Our results show that pointing information improves interpretation a...
متن کاملSalience Theory and Pricing Stock of Corporates in Tehran Stock Exchange
How the investors react to the received information plays a crucial role in determining the return of stock exchange market. Supply and demand based upon incorrect decisions lead to the price deviation of inherent values. This paper aims to study the impact of salience phenomenon on disproportionate pricing and investor overreaction in the corporates in Tehran stock exchange. Research methodolo...
متن کاملA Salience Driven Approach to Robust Input Interpretation in Multimodal Conversational Systems
To improve the robustness in multimodal input interpretation, this paper presents a new salience driven approach. This approach is based on the observation that, during multimodal conversation, information from deictic gestures (e.g., point or circle) on a graphical display can signal a part of the physical world (i.e., representation of the domain and task) of the application which is salient ...
متن کاملEnglish/Italian Bilinguals Switch Gesture Parameters when they Switch Languages
We investigated gestural communication in early bilinguals. In particular, we tested which aspects of gestures were “transferred” from a language to another. Though transfer in spoken languages has been studied extensively, transfer in gesture is understudied. Gesture transfer can provide useful information on the cognitive architecture in bilingualism. In this study our focus is on gesture rat...
متن کاملProcessing of semantic information in fluently spoken language
We are interested in constructing machines which learn to understand and act upon fluently spoken input. For any particular task, certain linguistic events are critical to recognize correctly, others not so. This notion can be quantified via salience, which measures the information content of an event for a task. In previous papers, salient words have been exploited to learn the mapping from sp...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010